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Abstract 

We consider the problem of asymptotic reconstruction of the state and parameter 
values for dynamical systems that cannot be transformed into the canonical adaptive 
observer form. A solution to this problem is proposed for a class of systems for 
which the unknowns are allowed to be nonlinearly parameterized functions of state 
and time. Going beyond asymptotic Lyapunov stability, we provide for this class 
of systems a reconstruction technique, based on the concepts of weakly attracting 
sets, non-uniform convergence, and Poisson stability. 

Key words: Adaptive observers, nonlinear parametrization, weakly attracting sets, 
unstable attractors, nonlinear systems, Poisson stability 



1 Introduction 



Often when studying and modeling real-life systems we come across a dynam- 
ical system of which we can register the input-output relations as functions of 

* Corresponding author 



Preprint submitted to Elsevier 



16 March 2009 



time, but are unable to fully control the input the system receives over time. 
Suppose we know enough about the system to specify its equations, but to 
complete its description so that prediction of the system behavior over some 
interval of time is possible, we must recover the values of the internal system 
variables and parameters that are not available for direct observation. In this 
case, a powerful method for doing so is Adaptive Observer Design. 

Observer-based methods can reconstruct both state variables and parameters, 
provided that the original system has, or can be transformed into, the canon- 
ical adaptive observer form [3]: 



Function g : ]R>o — > M""*""^ represents the known input, function : M x M>o 
M"+^ X M'^ is a known function of the observed output yit), k = (fci, . . . , kn) 
is a vector of known constants, F is a known n x n matrix (usually diagonal), 
and G M'^ is a vector of unknown parameters. Algorithms are available in [3], 
[17p1 that guarantee asymptotically stable (and sometimes even exponentially 
fast with arbitrary rate of convergence [19j) reconstruction of the unknowns, 
i.e. the state and parameter vectors. 

However, many important systems in, for instance, chemical kinetics [7], [2] 
and biology [12j, are not in canonical adaptive observer form. Unknown pa- 
rameters in F and nonlinear parametrization characterize these systems. Ab- 
sence of a canonical representation for these systems prevents straightforward 
application of standard observer-based techniques for state and parameter es- 
timation. 

A usual way to deal with this obstacle is to search for a bijective coordinate 
and parameter transformation reshaping the original system equations into 
the canonical form. Finding such a transformation, however, is a non-trivial 
problem. Available necessary and sufficient results in this direction apply to a 
too narrow class of systems (see e.g. [16j). Alternative, and possibly parameter- 
dependent, transformations may not be satisfactory either. 

This leaves us with the undesirable options to use heuristic methods or ex- 
haustive search. Whereas the former are not guaranteed to work, the latter 
can be forbiddingly expensive in terms of computational costs. 

^ See also [18] for the treatment of this problem when the regressor (p{y{t),t)0 
in ([T]) is replaced with a nonlinearly parameterized function of the output y and 
parameter vector 9. 
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We propose a solution that combines the advantage of exponentially fast con- 
vergence with the flexibility of explorative behavior. Fast convergence is re- 
served for available estimators for state and linear parameters 6 of (^^; explo- 
ration is reserved for the non-linear parameters an and the unknowns in F. 
The proposed method therefore bears an overall similarity to |25], |TT], |20j . 
[21], [27j. However, instead of sticking to the framework of Lyaunov stability 
we relax the problem further and invoke the concepts of weakly attracting sets 
and relaxation times |22], [8], |9] in our argument. The method is based on 
results of [25] that allow us to analyze asymptotic convergence in nonlinear 
systems beyond the framework of Lyapunov design. We show that, subject 
to a condition of persistent excitation of the parameterized uncertainty, it is 
possible to reconstruct both linear and nonlinear parameters of the system. 
The latter result is illustrated with three examples. 

The paper is organized as follows. In Section [2] we define the notation used 
throughout the paper. Section [3] provides the formal statement of the problem. 
Section H] contains the main results. Section [5] provides illustrative examples, 
and Section [6] concludes with a brief discussion. The proofs of all formal state- 
ments are provided in the Appendix. 



2 Notation 



The following notational conventions are used throughout the paper: 

• M>o = {x e M I X > 0}. 

• Z denotes the set of integers, and N stands for the set of positive integers. 

• The Euclidian norm of x G M" is denoted by ||x||. 

• By L^[tQ, T], to > 0, T > to we denote the space of all functions f : ]R>o 

such that ||f ||oo,[to,T] = esssup{||f t G [to,T]} < oo; ||f ||oo,[to,T] stands 
for the L2o[to,T] norm of f(t). 

• C denotes the space of continuous functions that are at least r times dif- 
ferent iable. 

• Let ^ be a subset of M"', then for all x G M."', we define dist(^, x) = 
infgg^ ||x - q\\. 

• O(-) denotes a function such that lims^o C'(s)/s = d, d E M, d 0. 

• Finally, let e G ffi>o, then ||x||^ stands for the following: 
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3 Problem Formulation 



We consider the following class of single-input-single-output nonlinear sys- 
tems: 

xo = &l 0o(3^o,Po,^) +Er=iQ(a;o,gi,i^)a;i + co(xo,go,i) +^o(i) ^u{t) 

ii = -/5i(a;o,ri,t) xi + 6*^ 0i(a;o,pi, t) 

< ' (2) 

Xi = -f3i{Xo,Ti,t) Xi + ef(f)i{Xo,Pi,t) + ^i{t), 

^Xn = -/3„(Xo,r„,t) Xn + 0'^4)i{xo,Pn,t) +^„(t), 



y = (1, 0, . . . , 0) X = xo, Xi(to) = a;i,o e ^, 
X = col(xo, xi, . . . , x„), 9i = col(6'i,i, . . . , 6'i,dJ, 

where 

(f)i :R X R'"^ X M>o 0^ G C°, ci^, mi G N, i = {0, . . . , n} 

/3i :M X M X M>o ^ M>o, A G C°, i = {1, . . . , n} 

a :M X R''> X R>o M, Q G C°, G N, i = {0, . . . , n} 

are continuous and known functions, u : ]R>o ^ M, m G C° is a known function 
of time modelling the control input, and C,i '■ lR>o d ^ ^ire functions 

that are unknown, yet bounded. The functions ^j(t) represent unmodeled dy- 
namics (e.g. noise). 

Variable y in system ([2]) is the output, and the variables Xi, i > 1 are the 
components of state x, that are not available for direct observation. Vectors 
6i G M'*' consist of linear parameters of uncertainties in the right-hand side of 
the 2-th equation in ([2]). Parameters G M, i = {1, . . . , n} are the unknown 
parameters of time- varying relaxation rates, /?j(xo, t,, t), of the state variables 
Xi, and vectors pi G M™', qi G W\ consist of the non/mear parameters of the 
uncertainties. The functions Ci{xo,qi,t) are supposed to be bounded. 

Systems ([2]) model the dynamics of neural membranes [12j; they describe var- 
ious chemical oscillators [2]; a number of important models in ecology, e.g. 
Lotka-Volterra equations, can be reduced to ([2]) by a, possibly parameter- 
dependent, change of coordinates (see our Examples section for details). For 
these reasons alone equations ([2]) constitute an interesting class of systems 
with remarkable practical relevance. On the other hand, and from a more the- 
oretical viewpoint, system may be viewed as a natural nonlinear extension 
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of the standard adaptive observer canonic form ([T]) in which the regressors are 
allowed to be nonlinearly parameterized and relaxation parameters, are 
time-varying and uncertain. 

For notational convenience we denote: 

6> = COl(^^0,^^l,--- ,^n), 

A = col(po,go,7-i,pi,gi • • . ,r„,Pn,gn), 

n 

s = dim (A) = n + ^(mj + rj). 

j=0 

Symbols Qq and Qx, respectively, denote domains of admissible values for 6 
and A. 

The system state x = col(xo,a;i, ■ ■ ■ ,Xn) is not measured; only the values of 
the input u(t) and the output y{t) = xo{t), t > to in ([2]) are accessible over 
any time interval [to,t] that belongs to the history of the system. The actual 
values of parameters 0, A are assumed to be unknown a-priori. For simplicity 
of the proofs, we assume them to lay within a hypercube with known bounds: 

^hj ^ [^i, mill) ^i, max] 5 ^ [-^i,min; •^i,max] • 

To reconstruct the unknown state and parameters of system from the values 
of y{t) = Xo(t), u{t), we should find an auxiliary system 

q = f(q,y(t),t), q(to) = qo, q G (3) 

such that for some given h : M'' ^ MP, p = dim(col(0^, A"^, X"^)), qo, 5 G M>o 
and all to ^ I^>o the following property holds: 

3t'>to: ||h(q(t,qo))-w(t)|| <5, \f t > t' (4) 

where w(t) = col(0. A, x(t, xq)). System is usually referred to as an adap- 
tive observer. 

The goal requirement for our adaptive observer is stated in the form of inequal- 
ity O, instead of the more usual requirement lim^^oo h(q(t, qo)) — w(t) = 0. 
This is because we allow unmodeled dynamics, C,i{t), in the right-hand side of 
([2]). As a result of such practically important addition, there is a possibility 
that (jl]) is satisfied not only for the original system exclusively, but it may also 
hold for a set of systems. The vector-fields in the right hand side of each ele- 
ment of this set are to be sufficiently close to that of ([2]), yet their parameters 
could be different. Instead of just one value of unknown parameter vectors 0, 
A we therefore have to deal with a set of 0, A corresponding to the solutions 
of ([2]) that over time are sufficiently close. This set of model parameters is 
referred to as an equivalence class of ([2]). 
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In the next section we demonstrate that despite the non-uniqueness of the so- 
lution, asymptotic reconstruction of state and parameters of ([2]) is achievable, 
subject to a standard persistency of excitation condition. 



4 Main Results 



Traditionally, methods of observer design are based on the notion of Lyapunov 
stability of solutions. If a globally asymptotically Lyapunov-stable solution 
exists in the state space of the combined system ([2]), ([3]) such that the re- 
quirements (jl]) are satisfied, then ([3]) is the observer needed. However, as we 
mentioned earlier, in systems with nonlinear parameterization and unmodeled 
perturbations distinct parameter values in the right-hand side of ([2]) may cor- 
respond to indistinguishable input-output behavior. Hence multiple distinct 
invariant sets in the extended state space will co-exist, and only local stabil- 
ity would generally be guaranteed. In order to deal with these issues, novel 
concepts of observer design are needed. 

We propose a method for finding adaptive observers ([3]) for ([2]) that rests on 
a two- fold idea. First, instead of the standard requirement that the dynamics 
of errors of state and parameter estimates is globally asymptotically stable in 
the sense of Lyapunov, we will require mere convergence of the estimates as 
specified by @. This relaxation allows us to invoke a wider range of tools for 
accessing convergence such as in [28]. 

Second, similarly to canonical observer schemes [16], [T7|, [18], [19] we shall 
be relying on the possibility to evaluate the integrals 

"'to 

at a given time t and for the given values of Xj, pi within a given accuracy. 
In classical adaptive observer schemes, the values of l3i{xo,Ti,t) are constant. 
This allows us to transform the original equations by a (possibly parameter- 
dependent) non-singular linear coordinate transformation, $ : x i— >■ z, Xi = Zi, 
into an equivalent form in which the values of all time constants are known. 
In the new coordinates the variables Z2, . ■ . ,Zn can be estimated by integrals 
([5]) in which the values of /3i(xo, Tj, t) are constant and known. This is usually 
done by using auxiliary linear filters. In our case, the values of Pi{xo, Ti, t) are 
not constant and are unknown due to the presence of r^. Yet if the values of 
would be known we could still estimate the values of integrals (E]) as follows 
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where T G ]R>o is sufficiently large and t > T + to- 

Alternatively, if (j)i{xo(t),pi, t), (3i{xo{t), Xj, t) are periodic with rationally - de- 
pendent periods and satisfy the Dini condition in t, integrals ([5]) can be esti- 
mated invoking a Fourier expansion. Notice that for continuous and Lipschitz 
in Pi functions iii{t,Ti,pi) the coefficients of their Fourier expansion remain 
continuous and Lipschitz with respect to pi. 

In what follows we show that the availability of a computational scheme which 
is capable of evaluating the integrals with sufficient accuracy enables us to 
design an adaptive observer that, under some mild and standard persistency 
of excitation assumptions, ensures asymptotic estimation of the unknown pa- 
rameter values of ([2]). 

4-1 Observer definition and assumptions 

Consider the following function (^(xq, X,t) -.RxW x R>q ^R'^,d = J27=o 
(p{xo,X,t) = (0o(xo,Po,^),Ci(xo,gi,t)/ii(t,ri,pi),... 

{Xo,qn,t)fIn{t,Tn,Pn)) 

The function (p{xo,X,t) is a concatenation of (/>o(') integrals ([5]). We 
assume that the values of (p{xo, A, t) can be efficiently estimated for all xq, A, 
t > up to a small mismatch. In other words, we suppose that there exists a 
function (p{xo, A, t) such that the following property holds: 

||(^(xo,A,t) -<p(xo,A,t)|| < A^, A^gM>o, (8) 

where values of ^(xq. A, t) are efficiently computable for all Xq, A, t (see e.g. 
([6]) for an example of such approximations), and A<^ is sufficiently small. 

If parameters r,, pi, and qi in the right-hand side of ([2]) would be known 
and Ci{xo,qi,t) = 1, i3i{xo,Ti,t) = Ti, then the function (fi{xo,X,t) could be 
estimated by {<Pq{xo, t), r^i, . . . , where rji are the solutions of the following 
auxiliary system (filter) 

Vi = -nVi + (t>iixo,Pi,'t) (9) 

with zero initial conditions. Systems like (Q are inherent components of stan- 
dard adaptive observers [13], [IZ|. In our case we suppose that the values of r,. 
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qi, Pi are not know a-priori and that Ci{xo,qi,t), Pi{xo,Ti,t) are not constant. 
Therefore, we replace rji with their approximations, e.g. as in ([6]): 

(p{xo, A, t) = (0o(xo,Po, t), Ci(xo, gi, ri,pi), . . . 

. . . ,Cn{Xo,qn,t)p,n{t,Tn,Pn)) ■ 

For periodic 0j(xo(t),Pi, t), Pi{xo(t), Ti,t) a Fourier expansion can be employed 
to define (p{xo, A, t). The value of in ([8]) stands for the accuracy of approx- 
imation, and as a rule of thumb the more computational resources are devoted 
to approximate (p{xo, A, t) the smaller is the value of A,^. 

With regard to the functions C,i{t) in ([2]) we suppose that an upper bound, A^, 
of the following sum is available: 

n ^ 

E -Ile.(r)||oo,[to,oo] + ||eo(r)l|oo,[to,oo] < A^, A^ G R>o. (10) 



Denoting co(xo,go?^) = Co(xo,A, t), for notational convenience, we can now 
define the observer as 



= -a{xo - Xq) + 6 (fi{xo, A, t) + Cq^Xq, A, t) + u(t) 
= -7e(£o - Xo)<p{xo, A, t), 7e, a E ]R>o 

Xi = -pi{xo,fi,t)xi + 9j^i{xo,Pi,t), i = {l,...,n}, 



:i2) 



where 6 = col(^O) • ■ ■ , 6n) is the vector of estimates of 6. The components 
of vector A = co\{po,qo,fi,pi,qi, . . . ,fn,Pn,qn) = col(Ai, . . . , A^), with s = 
dim (A), evolve according to the following equations 



I ,y»2 



Xij = ^ ■ LOj ■ e ■ (^Xij — X2J — Xij 

X2J = 7 ■ ■ e ■ (xij + X2,j - X2,j [xlj + xlj)) 



e 



Aj,min 



+ (Xij + 1), 



2 



{1 



1, 



(13) 



(14) 



>o is a bounded continuous function, i.e. a{v) < S E M>o, 

>o and let uj be rationally- 



where cr(-) : R - 

and |cr(t;)| < for all t; G M. We set uoj G 



independent: 



'^ojjkj 7^ 0, V kj G Z. 



(15) 



A proof that system (fTTj) - (fT3!l can serve as the desired observer ([3]) requires 
the concepts of non-uniform convergence p2], [9], non- uniform small-gain the- 
orems [28j, and the notions of X-uniform persistency of excitation [T3] and 
nonlinear persistency of excitation [6] : 
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Definition 1 (A-uniform persistency of excitation) Let ip : R>o x V ^ 

j^nxm^ X> c M.^ be a continuous function. We say that cp{t, A) is X-uniformly 
persistently exciting (X-uPE) if there exist fi G IR>oj L G M>o such that for 
each \ G V 

ft+L 

J (p{t,\)ip{t,\fdT>niyt>to. (16) 

In contrast to conventional definitions [26], the present notion requires tliat 
the lower bound for the integral Jl^^ (p{t, X)cp{t, X)^dT in (fT6l) does not vanish 
for all A G and is separated away from zero. We need this property in order 
to determine the linear parts, 6i, of the parametric uncertainties in model ([2]). 

To reconstruct the nonlinear part of the uncertainties. A, we will require that 
(p{xQ, A, t) is nonlinearly persistently exciting in A. Here we adopt the defini- 
tion of nonlinear persistent excitation from [6] with a minor modification. The 
modification is needed to account for a possibility that 

cp{xo, A, t) = cp{xo, A', t), A 7^ A', t G M, 

which is the case, for example if cp{xQ,X,t) is periodic in A. The modified 
notion is presented in Definition [2] below. 

Definition 2 (Nonlinear persistency of excitation) The function 
(p{xo,X,t) is nonlinearly persistently exciting if there exist L, P E M>o such 
that for all A, A' G Qx and t G M there exists t' G [t — L, t] ensuring that the 
following inequality holds 

\\ipixo,X,t)-ipixo,X',t')\\>(3- dist(£:(A),A'), (17) 

^(A) = {A' G nx\ ^{xo, A', t) = <p{xo, A, t) V t G M} (18) 

The symbol S{X) denotes the equivalence class for A, and dist(£^(A), A') in 
(1171) substitutes the Euclidian norm in the [6] original definition. The nonlinear 
persistency of excitation condition f[T7|) is very similar to its linear counterpart 
(1161) . In fact flTBl) can be written in the form of inequality ([T7|l . cf. [23j. For 
further discussion of these notions, see [6], [H]. 

In our work we use condition (fT6l) to ensure state boundedness of the observer 
and to enable reconstruction of linear parameters 6i in the original equations 
([2]). Condition (fT7j) is used to formulate the requirements for successful recon- 
struction of nonlinear parameters Pi and unknown relaxation times r^. 
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4-2 Asymptotic properties of the observer 



The main results of this section are provided in Theorems [3] and [51 Theorem 
|3] estabhshes conditions for state boundedness of the observer, and states its 
general asymptotic properties. Theorem [5] specifies a set of conditions for the 
possibility of asymptotic reconstruction of 9i, Ti, and pi, up to their equivalence 
classes and small mismatch due to errors. 

Proofs of Theorems [31 \5\ and other auxiliary results are provided in Appendix. 

Theorem 3 (Boundedness) Let system Ij^, 07]) - / [73]) be given. Assume 
that function y'(xo(t), A, t) is X-uniformly persistently exciting, and the func- 
tions <^(xo(t), A, t), co(a;o(^)? A, t) are Lipschitz in \: 



\^{xo{t),\t) - (^(a;o(t), A',t)|| < D\\X-Xl 
|co(a;o(t), A,t) - co(a;o(i), A',t)|| < Dc\\\ - A'||. 



(19) 



Then there exist numbers e > 0, 7* > such that for all 7 G (0,7*].' 

1 ) trajectories of the closed loop system ( f77]) - ( f7^) are bounded and 

lim ||xo(t)-Xo(t)||. = 0; (20) 

t— >oo 

2) there exists \* eVL\, k E M>o such that 



lim A(t) = A* 



t— >oo 



limsup \\e{t) - e\\ < K{{D\\e\\ + D^)\\X* - X\\ + 2A). 



(21) 



A = ||6>||A^ + (22) 

Remark 4 Theorem [31 assures that the estimates 0(t), X(t) asymptotically 
converge to a neighborhood of the actual values 6, A. It does not specify, 
however, how close these estimates are to the true values of 0, A. 

Our next result states that if the values of A^ and A^: 

\\(p{xo,X,t) - ^(xo, A,t)|| < A^ 

n 

I]-||^i(^)||oo,[t„,oo] + ||^o(r)||oo,[to,oo] < 
1=1 'i 

in dHD, ([TOl) are small, e.g. ^(xo(t). A, t) approximates c^(xo(t). A, t) with suffi- 
ciently high accuracy and the unmodeled dynamic is negligible, the estimates 
6{t), X{t) will converge to small neighborhoods of the equivalence classes of 
0, A. The sizes of these neighborhoods are shown to be bounded from above 
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by monotone functions A: 

A = ||0||A^ + A^ 
vanishing at zero. Formally this result is stated in Theorem [5] below 

Theorem 5 (Convergence) Let the assumptions of Theorem\^hold, assume 
that ipQ{xQ,\,t) G , the derivative d(pQ{xo{t), X,t)/dt is globally bounded, 
and A = ||0|| A^ + A^ is Then there exist numbers £ > 0, 7* > such 

that for all 7^ G (0,7*) 

1) 

limsup \\e{t) - 0\\ = 0{VA) + C(A) 

>oo 

2) in case 6'^ip{xo{t), X,t) + CQ{xo{t), X,t) is nonlinearly persistently exciting 
with respect to X, then the estimates X{t) converge into a small vicinity 
ofS{X): 

limsup dist(A(t),£(A)) = 0{^/A) + 0{A) (23) 

t^oo 



5 Examples 

We illustrate our method with three examples. The first example deals with 
the problem of parameter reconstruction of the Duffing oscillator assuming 
that only one state variable is available for direct observation. This problem 
received considerable attention in the past and hence can serve as a bench- 
mark. Existence of an output feedback steering the state of the Duffing system 
to an arbitrary small neighborhood of the origin in the presence of parametric 
uncertainties was demonstrated in [23], [T5|. Recently, a method for asymp- 
totic reconstruction of all parameters of the Duffing system was published in 
[1]. Here we show how our own method performs in this task provided that 
the frequency of external perturbations is known. 

The second and the third examples address a more difficult class of problems 
in which the uncertain parameters enter the model nonlinearly and/or the 
functions q(xo, ^i, t) in ([2]) are not constant. In particular, we consider a two- 
component bio-reactor model [2] and a bilinear Lotka-Volterra system. We 
show that in both cases, subject to the chosen tolerance margin, state and 
parameters of these models can be successfully estimated from input-output 
observations with our adaptive observer. 



^ The bounds defining smallness of A are provided in ()A.35p - ()A.37p in Appendix 
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Example 1. Parameter estimation of the Duffing oscillator. Consider the fol- 
lowing system of differential equations 



Xq = Xi 



Xi = —6xi — I3xq — oXq + 7 cos(c<ji(;), y = xq, 



(24) 



where S G (0.1,1), /3, a, 7 G M, are parameters of which the values are 
supposed to be unknown, and xq measured. The value the frequency of periodic 
forcing, i.e. u, is supposed to be known. In this example we set 



S = 0.2, a = 1, /? = -1, 7 = 0.3, = 1, 



(25) 



and the task is to reconstruct the values of 6, a, /?, and 7 asymptotically from 
the measurements of Xq. 



(26) 



For convenience we rewrite (1241) using the notational agreements as in 



Xo = Xi 



xi = -TlXi + Oi^iXq + 9i^2xl + 611^3 cos(co't). 
According to ([7]), we start with constructing the following regressor function 
ip{xQ, A, t) = {(pi{xo, A, t), (p2ixo, A, t), (p3{xo, A, t)) 



-n(i-r) 



to 



Xo{T)dT, 



to 



XQ{T)dT, 



-Tiit-r) 



to 



COs{uJT)dT 



where A = ri. For the given parametrization of the regressor satisfies the 
requirement of uniform persistency of excitation (the value of /i ranges from 
1.2 for ri = 1 to 1000 for n = 0.2 at L = 500). Following (fITl) - (fT3|), the 
structure of the observer is defined as follows: 



{xo -xo) + Y^ 9i^iipi{xo, A, t) 



i=l 



(27) 



= -7e(£o - xo)ipi{xo, A, t) 
7 ■ e ■ {^xi^i - £2,1 - xi,i (xl i + x\^ 



7 ■ e ■ ( + X2,i - X2,i [x{ 1 + xl ^ 



Xl^l 
X2,l 

-^(^1,1 y ' 'mill I 2 

e = cr(||xo - XolU) 



max 



A, 



^(Xl,l + 1) 



(28) 



where cr(-) = tanh(-) and the parameters of the observer are set as follows: 7 = 
0.2, 70 = 2, Amin = 0.1, Amax = 1.1, £ = 0.01. Performance of adaptive observer 
system (l26l) . (127|) . (!28|) is illustrated with Fig. [H In this example the estimates 
reached 5-percent neighborhood of the true values of model parameters at 
2000 units of time. To achieve the same accuracy by the exhaustive-search 
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Fig. 1. Left: estimates Oi as functions of time for fixed A = ti. We see that Oi 
converge to a small vicinity (5%) of their true value in 400 sec of model time. Right: 
estimates Oi and A as functions of time in the closed- loop system (j26l) . (p7|) . (p8|) . 
All estimates converge to small neighborhoods of their true value in 2000 units of 
time. 



would require covering the interval [0.1,1.1] with a 0.01-resolution grid, for 
which 100 tests are needed. Thus the overall time spent to recover the value of 
Ti would amount to 40000 units of time, which is already in this simple case 
much larger than the time that our method requires. 

Example 2. A Bio-reactor model. Consider the following system of equations 



Sq = —dso + du{t) — br{so, k)si 
Si = -dsi + r(so, k)si, r(so, k) 
y = So, 



So + k' 



(29) 



where sq, si are products (concentrations), d is the dilution rate, r{so,k) is 
a Monod-type nonlinearity, rmax is the maximum growth rate, 6 > is the 
growth yield, and k is the "half saturation" constant. The measured output is 
the variable Sq. The values of parameters rmax, b are supposed to be known, 
and precise values of parameters d, k are considered unknown. 



According to the requirements of our method we need that the system equa- 
tions are presented in the form ([2]) where /3j(-, ■, ■) > 0. For the chosen model 
(1291) this requirement may not hold for the values of d, k are unknown, and 
hence we cannot tell if Pi = d — r{xo{t),k) remains positive at all t. Let us 
therefore transform fl2^ into ([2]) by the following parameter-dependent non- 
singular transformation: 



Xi 



r{bSi + Sq), Xo = Sq. 
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In the new coordinates the system dynamics is described as follows: 

= -dXo + du{t) ^T-T^^l + ^max , 3^0 

xi = -dxi + rm^y,du(t), 

y = xo, 

Denoting ^0,1 = -d, 9q^2 = d, qi = k, ci(xo,gi) = -xo/(xo + k), n = d, 
61,1 = Tm-a^d, po = k, Co{xo, go) = r^i,^xl/{xo + k) we can rewrite ([30]) as 



3^0 = dl(t)Q{xQ,pQ,t) + ci(xo,gi)a;i + co(a;o,go) 

xi = -nxi + ^1,101 (t), e = (^0,1, ^0,2, ^l,!)"^, 00 = (00,1, 00,2) 

where 

Mxo,PO,'t) = {xo,u{t)), (j)i{t) = u{t). 

Taking ([6]) into account, and that = qo = qi = k we define 

<^(xo,A,t) = f e-^^^'-^\{x)d^ , 

\ XQ[t)+PoJtQ J 

>^ = (po,n) = (Ai, A2). 



(31) 



According to ffTTl) - f|T3|l . the structure of the observer is: 



Xq 



-(xo -xo) + Y^ OiLpi{xo, A, t) + co(xo, A) 



i=l 



-le{xo - Xo)(Pi{xo,X,t) 



(32) 



3^1,1 
X2,l 
Xl,2 
X2,2 



7 ■ cui ■ e ■ - £2,1 - £1,1 1 + X2_i)) 
7 ■ ■ e ■ (xi^i + X2,i - X2A (xl i + £2^1)) 
7 ■ co'2 ■ e ■ (xi^2 - a;2,2 - ^'1,2 f^'? 2 + ^2 2 



7 ■ u;2 ■ e ■ ( a;i,2 + ^2,2 - 3:2,2 [XI2 + 



X 



2,2 



Ai(a;i,i) — Amin^i + 



-^max.l '^min, 1 



(^^1,1 + 1), 



A2(3;i,2) — Amin,2 H '"''"■^ """'^ (xi,2 + 1), 



tanh(||xo(t) — xq 



(33) 



Parameters Ui, 002 in ([3SD are to be rationally independent. In our example we 
set these parameters as follows: tui = tt, 0^2 = 2\pl. Other parameters of the 
observer were set as 7 = 0.0001, e = 0.03, 79 = 0.001, a = 1. Parameters d 
and k of the reactor model were set to 0.3 and 70 respectively, and the input 
u{t) = 40(sin(0.2t) + 1.5). Results of computer simulations of the closed-loop 
system with this observer are provided in Fig. O As we can see from these 
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figures, state and parameter estimates converge into a vicinity of tlie true 
values of si and 9i, 62, O3, ti, k as t ^ 00. 

Observer fl33|) . witli minor modifications, can be easily tailored to deal with 
other similar models of chemical oscillators, such as e.g. [5], in which the 
function r{sQ,k) is replaced with an exponential nonlinearity. Furthermore, 
it can be used to estimate state and parameter values of various models of 
interacting species. We illustrate this below using the Lotka-Volterra system 
as an example. 

Example 3. Lotka- Volterra system. Consider the following system: 

X = x(a — y) , , 

. \ 34 

y = -y[i - ox), 

where x, y are the variables modeling the number of prey and predators in 
an isolated population. Parameters a, 7, and 5 are supposed to be unknown, 
and X is measured. We wish to be able to estimate the values of all model 
parameters and also recover the values of y from the measurement of x over 
time. 

Similarly to the previous example, we introduce the following nonsingular 
coordinate transformation: 



Xq = X, Xi = y + 6x. 
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Fig. 3. Left: estimates 0i, f = X as functions of time. Right: y = xi — O2XQ (dotted 
line) and y (solid line) as functions of time in the closed-loop system (p5]) . ([36]) . 

m. 



In the new coordinates system (IMI) is defined as 

Xo = OiXq + 02x1 + Ci(Xo)Xi 
Xi = -TlXi + 6*2X0, 

6*1 = a, 02 = 5, n = 7, 9s = 5{a + 7), ci(xo) 



(35) 



According to ( |TT|) - ( |T3l) . the following system can serve as an observer for 



i=l 





= -leixo - Xo)Lpi{xo, A, t) 




Xl,l 


= 7 ■ e • (^xi,i - X2,i - xi,i (xi i 




X2,l 


= 7 ■ e ■ (xi,i + X2,l - X2,l (xf^i 




A(xi,i) 


= Ai^in+ ^--~^-'"(xi,i + 1), 




e 


= tanh(||xo(t) - Xo(t)|y, 





(36) 



(37) 



where 



^(xo(t),A,t) = (^xo(t),x2(t),-xo(t)£e-^^(*->^)xo(x)c/x 



We simulated system (l35l) . (!36|) . (1371) with the following parameters of the 
observer: e = 0.0005, 7 = 0.0015, 7^ = 0.02, a = 1, A 
Results of the simulation are provided in Fig. [3l 



mm 0.2, Ajjiax 0.6. 
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6 Conclusion 



We derived, under suitable assumptions, an observer that can reconstruct 
the unknown parameters of a general class of nonlinear systems, specified 
by equation ([2]). Reconstruction is subject to conditions of linear /nonlinear 
persistency of excitation. According to Theorem \5[ the values of parameters 
can be reconstructed with arbitrarily small errors (up to their equivalence 
class). Hence there exists a time instance t' such that solutions of (fT2!) will 
enter a sufficiently small neighborhood of Xi(t) aX t = t' and will stay there 
for all t > t' provided that the values of A^, in ([8]), (ITOl) are sufficiently 
small. Having solved the parameter reconstruction problem, we obtain the 
state variables by applying the filter (IT^ . 

To ensure convergence we have gone beyond the usual requirement of Lya- 
punov stability. The set to which the estimates converge is not stable in the 
Lyapunov sense; any neighborhood of this set contains a nonempty subset of 
points corresponding to trajectories escaping this neighborhood in finite time. 
Yet the set is attracting in a weaker, Milnor sense, cf. [22], and furthermore 
it is made Poisson stable by design. The amount of time required for conver- 
gence in our approach depends heavily on the subspace being searched, it does 
not depend on the dimension of the linearly parameterized part. This renders 
the method more efficient than exhaustive search; the fewer uncertainties, rel- 
atively speaking, belong to the nonlinear part, the more advantageous our 
method becomes. 
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Appendix 

A . 1 Proof of Theorem 

In order to prove the theorem we will need the following lemma. 
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Lemma 6 Let the system HI]) . / fl^) be given, and the function cp{xo{t), X,t) 
be \-uniformly persistently exciting. Then there exist numbers p > 0, Dp > 0, 
Ci > 0, C2 > 0, 7 > 0, such that for all 7j G (0,7) the following holds along 
the solutions of system 07]) . /[T^) : 

\\xo{t) - xom < e-^(*-*«)D,(||x(to) -x(to)|| + \m - 0(to)||) 

+ ci||A(r) - A||oo,[to,t] 
\m - e{to)\\ < e-^(*"*«)D,(||x(to) - x{to)\\ + \m - 9{to)\\) 
+ C2||A(r) - X\\oo,[to,t] + d2 

ci = C2 = {\\e\\D + D,)Dpp-\ d,=d2 = 2(||6>||A^ + A^)Dpp-' 

Proof of Lemma Consider the following functions 
r]{X, t) = c^(xo(t), A, t) - ip{xo{t), A, t) 

X{t) = f:Q(xo(t),g.,t) /%-/>'(^«(^)'-''^)'^^(r)rfr + eo(t) ^^'^^ 



i=l 



According to ([HD, (ITUil the functions 77 (A, t), xif) are bounded: ||77(A, r) ||oo,[o,t] ^ 
^¥3 5 ||x(''")||oo,[o,t] < Now introduce the following vector 



q = col(xo -Xo,6/^ - 0^). (A.3) 
Taking into account ([2]), (fTTI) . its time-derivative can be expressed as follows: 

gi = -a gi + ^(xo,A,t) + Co(xo(t), A, t) - 6q 4>Q{xoit),po,t) 

n 

-^Cj{xo{t),qj,t)xj{t) -Co{xo,X,t) -^oit) (A.4) 

gi = -le qi ^iMt), X,t), i = {!,..., n} 
Expressing trajectories Xi{t) in ([2]) in the closed form 

"'to 

•Ito 

and taking ([7]), (]A.2p into account, we can rewrite (]A.4|) as 
gi = -a gi + (61 - 6/)^c^(xo, A, t) + t;(A, A, t) 

(A. 5) 

= -7e gi '^iMt), X,t), i = {1,..., n}, 

where 

v{X, A, t) = e'^{(p{xo, A, t) - ^(xo, A, it)) + co(xo, A, t) - co(xo, A, t) 
+ 0^r7(t,A)-x(t) + e(t) 
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and e(t) is a bounded and exponentially decaying term. Rewriting (lA.SP in 
vector-matrix notation yields: 



q = A(A(t),t)q + b t;(A,A,t), (A.7) 

where 



A(A(t),t) 



-a (^(xo(t),A(t),tf 
l^-7e(^(xo(t),A(t),t) (A.8) 

b = (l,0,...,Of. 



Let $(t,to) be a solution of 

$ = A(A(t),t)$, $(to,to)=I (A.9) 
Then the solution of (]A.7p is defined as 

q(t) = $(t,to)q(to)+ r$(t,r)bt;(A(r),A,r)rfr, 

Jto (A.IO) 



t > t 







We are going to show that there exists 7 G M>o such that for all 7 G [0,7) 
solutions of (lA.7p . (fT3|) are bounded. 

First, we notice that trajectories Xij(t), X2j{t) are globally bounded. Further- 
more, the right-hand side of (IT^ is locally Lipschitz in xij, X2,j. Hence the 
following estimate holds: 



||A(i)|| < 7*M, M G M>o,7* = 7max{cu,}. (A.ll) 

j 

As follows from the assumptions of the lemma, the function ^(xo(t). A, t) is a 
A-uniform PE. This implies existence of L, G ]R>o such that 



^(xo(r). A, r)^^(xo(r). A, r)(ir > /xJ 
yt>to, AgI^a (A.12) 



Consider the following matrix: 
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J{X{t),t) - cp{xo{r),X{r),r)ip^{xo{r),X{r),T)dr 

ft+L _ „ _ ^ 

= i^Mr), A(t), r) - £p(a;o(r), A(r), r)) x 

(^^(xo(r), A(t), r)t/r + j'^"^ <^(xo(r), A(r), r) x (A.13) 

(c^(xo(r), A(t), r) - c^(xo(r), A(r), r))^rfr 
= Ji(A(t),t) + J2(A(t),t) 

Using the inequality 

||i7z|| < max|;ifc,/|||z||, G R""^", zeW 



k,l 



and given that ||c/7(xo(t), A, t) || < B for all t > 0, A G Qx, we can conclude 
that the matrix (lA.lSP satisfies 

z^(Ji(A(t),t) + J2(A(t),t))z < 
<2i?D||A(t)-A(r)|U,[M+L]||zf, /^G 



Hence 



£^(xo(t), A(r),r)(^ (xo(r), A(r), r)dr 

> J(A(t),t) - 2i?Z}||A(t) - X{T)\\^,it,t+L]I > ^^-^^^ 
(/i-2i?D||A(t)-A(r)|U,[,,+^])/ 

Taking (lA.llI) . (1A.14I) into account we can conclude that 



(^(xo(r), A(r),r)c^ (a;o(r), A(r), r)dr 
> (/i - 2BDLMY)I 



(A. 15) 



Then choosing 7 for instance such that 



we can ensure that 

rt+L 



^ c^(xo(r), A(r), r)c^^(xo(r), A(r), r)rfr > ^/ V t > to- 

In other words the function (p{xo{t), X{t),t) is persistently exciting. 
According to [23], this implies that the system 

q = A(A(t),t)q 
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is uniformly exponentially stable for all X{t) satisfying conditions (lA.lip . 
(IA.16p . Hence there exist p, Dp G ]R>o such that the following inequality 
holds 

mt,toMto)\\ < e-^(*-*°)||q(to)||/^p (A.17) 

for all q(to) e t > to, to E R. Therefore, taking f[O0l) . flXTTl) into account 
we can conclude that, for any bounded and continuous function v{t), solutions 
of flA.7p satisfy the following estimate: 



$(t,to)q(to)+ / Ht,T)hv{T)dT 

Jto 

< e~P^'~''^Dp\\q{to)\\+Dp f\~''^'~^^\\h\\\v{T)\dT. 



(A.18) 



Notice that according to (ITOl) . (fT9|) . (\A.6\i the function v{t) satisfies the fol- 
lowing inequality: 



|i;(t)| < i\\0\\D + D,)\\X{t) - All + ||6I||A^ + + |e(t)|. 



Hence 



||q(t)|| < e-^(*-*°)Z},||q(to)|| + (H^P + D,)Dp /* e-^(*--) || A(r) - A||dr 

Jto 

+ f e^'^*""^ {m\^^ + ^dDp + e(r)) dr. 

Because e{t) is exponentially decaying, there exists t' such that 

|e(t)|<(||0||A^ + A^)Z}, 
for all t > t'. Therefore for all t > to > t' the following estimate holds: 

. i\\0\\D + D,)Dp. 



|q(t)|| <e-''(*-*")D,||q(to) 
2(||6>||A^ + A^)Dp 



Mr) 



P 



,[to,t] + 



(A.19) 



Noticing that ||q(to)|| = y (2^0(^0) ~ ^^0(^0))^ + ll^(^o) ~ ^IP and using the in- 
equality y/a?~+l}^ < \^ + ^J\? we can conclude from flA.lQp that there exists 
t' G M such that for all t>to>t' estimate f[0|) holds □ 



According to Lemma [6] there exists a non-empty interval (0, 7) and t' G M 
such that for all 7 G (0,7) and all t > to > t' solutions of system ([2]), (ITT]) . 
( IT3i) satisfy inequality (lA.ip . 
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Now consider solutions of system 



Xii = UJj (xi^j - X2A - Xi ( X? . + xl 



Aj(Xij) — Aj^min H (Xij + 1) 

with initial conditions (|T4l) . They are forward- invariant on x1j{t) + X2 j(^) = 1 
and can be expressed as Xij{t) = sm{uj jt + /?), X2jit) = cos{ujjt + Taking 
into account that Uj are rationally-independent (condition f|T5l) in the defini- 
tion of the observer) we can conclude that the trajectories Xij{t) densely fill 
an invariant n-dimensional torus [1] , and system flA.20p with initial conditions 
^i,j(^o) +2^2j(^o) = 1 is Poisson-stable in fl^ = {xij,X2j G G [—1,1]}. 

This means that for any A G ^2;^, (arbitrarily large) constant T G M>o, (ar- 
bitrarily small) constant A a G M>o, and initial conditions on the torus there 
will exist X{t') = col(Ai(xi,i(t')), • • • , A,(xi,,(t'))) G ^a, t' - to > T, such that 
II A — A(t')|| < Aa, Aa G M>o. Expressing \(t) generated by (fT3l) in terms of 
the function X(t) yields: 

\{t) = \[to + l j' \\xo{r) - Xo{T)\ldT^ , t > to- 



Denoting 



we obtain 



h{t)=t'~-l[ \\Xo{t) - Xo{T)\\^dT 
J to 



\\{t) - All < Aa + ||A(t) - A(t')|| < Aa + D,^\h{t)\ 
h{t) = h{to) - 7 / ||xo(r) - xo{T)\\edT, 

J to 



(A.21) 



where Dx is a positive constant and h(to) = t'. Hence the following holds along 
the solutions of (|2|), (fTTj), (fT3|): 



\xo{t) - xom < e-P^'-'"^D^i\\xito) - xito)\\ + ||^(t) - 0{to) 

oo,[to,t] 

+ di + CiAa 

Wm - e{to)\\ < e-''(*-*«)z},(||x(to) - xito)\\ + \\m - e{to) 

+ C2Dx\\h{t)\\ oo,[to,t] + d2 + C2AX 



(A.22) 



where h{t) is defined as in flA.2ip . Ci = C2 = (||^||-D + -Dc)-DpP^^, and Aa is an 
arbitrarily small constant. Therefore, according to Lemma [8] in Section fA. 31 of 
the Appendix and invoking the argument as in Corollary 11 from [28j, we can 
conclude that there exists 7* and e* such that 

lim X{t) = A*, A* G ^A (A.23) 

t — »'00 
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lim \\xo{t) - xo(t)\\, 



0. 



t—^oo 



(A.24) 



for all 7 G (0, 7*), e > e*. Then denoting n = Dp/ p and using flA.lQp we obtain 
fl^Tl) . The value of 7*, as follows from Lemma [S] and flA.16p can be determined 
from 



7 = mm 



ABDLM 



mt p 

de(o,i), VG{l.oo) 



In 



1^ d 



1 



2f||6»||Z} + D.)D.D 



A 



1 - d 



□ 



A. 2 Proof of Theorem{5\ 



Similar to the proof of Theorem [3], equation ( lA.7p . we notice that equations 
governing the dynamics of our observer (fTT]) . (fT3l) relative to the dynamics of 
the original system can be described as follows 

q = A(A(t),t)q + bt;(A,A,t) ^5) 

y = c^q, 

where 

c = col(l, 0, . . . , 0), b = col(l, 0, . . . , 0), q = col(xo - Xq, 6^ - O'^), 
and system 

q = A(A(t),t)q 

is uniformly exponentially stable. Taking (]A.6|) into account we can express 
v{\, A, t) as: 

v{X, A, t) = 0^{(p{xo, A, t) - (p{xo, A, t)) + co(xo, A, t) - co(xo, A, t)+ 
O^riit, A) - x{t) + e(t) = Vo{X, A, t) + d{6, A, t) 

In the equation above Vo{X, A, t) denotes the term 6'^{cfi{xo, A, t)—(p{xo, A, + 
Co(xo, A, t) — Co(xo, A, t), and A, t) stands for d^r]{t, A) — x{t) + e{t). Hence 
( ]A.25I) transforms into 

q = A(A(t), t)q + b[t;o(A, A, t) + d{e, A, t)] 
y = c^q. 

To proceed further we will need the following lemma 
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Lemma 7 Consider the following system 



X = A(t)x + h{t)[u{t) + d{t)], 
y = c^x, c G M", X G M" 



(A.27) 



where 



u :l 
c/ :I 



^, u G C\ b : 



r, : 



I, dGC°, ||rf(t)|U,[to,oo] < 5, 5G 



^>o 



(A.28) 



and each entry of A{t) is a globally hounded function of t. Suppose that the 
following properties hold for (A. 21): 



1) the origin of system (A. 21) is asymptotically stable at u{t) = 0, d{t) = 

2) the term c^b(t) is separated away from zero: 



3 /3 G 



|c^b(t)| >/5 Vt G 



3) the time derivative of u{t) is hounded uniformly in t: 



3dU e 



\u{t)\ <dU\/tE 



Then 



\\y{t)\\oo,[to,oo] <e, e e M>o 
implies existence oft\e) > to such that 



(A.29) 

(A.30) 



iQedU 



6 > \u{t)\, V t > t'{e) 



provided that e is sufficiently small. 

Proof. First, notice that closed form solutions of (1A.27P are 

x(t) = to)xo + r r)b(r) [u(r) + rf(r)]rfr, 

Jtn 



(A.3i; 



where to) is the fundamental system of solutions of (1A.27I) generated by 

$ = A(t)$, $(to,to) = $o = /. (A.32) 
According to flA.311) we have: 

Vit) = c'^$(t, to)xo + r c^$(t, r)b(r) [u{t) + rf(r)]rfr 



Consider y(t) — y(t — T), T G 



y{t)-y{t-T) = to) - - T, to)] xo+ / c'^$(t, r)b(r) [M(r)+rf(r)]rfr 

Jt-T 

(A.33) 
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Denoting 

iy{t,T) = c'^ [$(t,to)-$(t-T,to)]xo 
and applying the mean-value theorem to flA.331) we obtain 

y{t) - y{t - T) = u{t, T) + Tc^<l>{t, r')b(r')[«(r') + c/(r')], r' G [t, t - T] 

Hence 

\yit)-y{t-T)\>T\c^^t,T')h{T')\ (Kr')| - M(r')|) - T)|, r'G [t,t-T] 

Because ( ]A.27p is asymptotically stable, the term T)| — > as t — oo, and 
there exists ti > M such that 

Ht,T)\ <e\/t>ti. 

On the other hand, condition (]A.30I) assures the existence of to such that 

\y{t) - y(t - r)| < 2£ V t > to, V T > 0. 

Therefore there exists t' = max(ti,to) such that for all T > and t > t' the 
following holds: 

3£>r|c^<|.(t,r')b(r')| (Kr')l-M(r')l), r'G [t-T,t]. (A.34) 
According to flA.291) . flA.281) . inequality flA.34p implies 

3£>T|c^$(t,r')b(r')| {\u{t)\ - 6) - T^\c'^^t,r')h{r')\ dU, r' G [t-T,t] 
Notice that 

^t,t) = / Vt G M 

and that r') is (uniformly) continuous in r' and |c-'"$(t, t)b(t)| > /3. Then 
there exists T' G ]R>o such that 

|c'^$(t, r')b(r') I > M = ^ V r' G [t - T', t] (A.35) 



Letting < T < T' we obtain 

3e 



MT 

Optimizing the left-hand side of ( 1A.36I) for T yields 



+ TdU + 6> \u{t) \Wt>t' (A.36) 



3edU , QedU , , . ^ , 



provided that 



< r, (A.37) 
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i.e. when e is sufficiently small. □ 



As follows from Theorem [3l property fl20l) . there exists a time instant t' such 
that 

||c^q(t)|| = ||xo(t) - Xo(t)|| <2s\/ t>t' 
In addition, vectors c, b in flA.25p satisfy c-^b = 1, and d{0,X,t) satisfies 



\die,X,t)\ < ||6>||A^ + A5 + |e(t)| = A+|e(t)|, 

where e{t) is an exponentially decaying term and A = ||0||A(p + A^. Let t": 
\€{t)\ < \\0\\A for all t > t", and to = min{t',t"}. This implies that 



c'q(t)||<2e, \d{e,X,t)\ <2A y t>to. 



(A.38) 



Finally, according to assumptions of the theorem there exists a constant dU G 
M>o such that 



Vo{X, A, t) 



0^(^o(xo(t),A,t)-^o(xo(t),A(t),t)) 



< dU 



Hence conditions of Lemma [7] are satisfied for system ( ]A.26p for all t > to- 
Therefore, according to Lemma [7] there exists ti > to such that 



|6>^(y.o(xo(t),A,t)-^o(xo(t),A(t),t))| <2(v/6i9f7+A)Vt>ti >to (A.39) 

provided that e is sufficiently small. Taking flA.381) into account, we can con- 
clude that 

|t;(A, A, t) I < 2{V6edU + 2A) V t > ti > to (A.40) 

Given that ( ]A.26[) is exponentially stable and that ( lA.ll) . ( ]A.40[) hold, the 
upper bound of the difference ||^(t) — 0|| at t oo can be estimated as 
follows: 

limsup ll^(t) - 6I|| < -{VGedU + 2A). 

t->oo p 

Thus statement 1) of the theorem is proven. 

To prove that statement 2) of the theorem holds we notice that, according to 
the definition of nonlinear persistency of excitation, constants L, (3 must exist 
such that for alH G M there exists t' G [t — L, t\\ 

|0^((^o(xo(t'), A,t') - ^o(xo(t'), A(t'),t'))l > dist(A(t'),^) 



Combining this with ( ]A.39[) yields: 

V t > ti 3 t' G [t - L, t] : 



dist(A(t'),^(A)) < -(y6iaf7 + A). 



(A.41) 
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Hence there is a sequence of t'^, i = 1,2, . . . such that ?>L>t[— t[_^ > L, and 



hm dist(A(t'),^(A)) < -(V6edU + A). 
Given that X(t^) are bounded we can choose t'j such that 

On the other hand, according to Theorem [3] A(t) converges to a point in Qx 
as t ^ oo: hmt_»oo X(t) = A*. Therefore A* = A and 



dist(A*,^(A)) < -{VQedU + A). 



The latter inequahty assures that 



hmsupdist(A(t),£(A)) < -{VOedU + A). 



Hence taking into account the bound for e defined by (lA.44p . statement 2) of 
the theorem foUows. □ 



A. 3 LemmalE 



Lemma 8 Consider an interconnection of systems that is governed by the 
following set of equations: 

< f3it - to)(||x(to)|| + lly(to)ll) + ci ||/i(r)|L_[,^,_,] + rfi, d, G M>o 
</3(t-to)(||x(to)|| + ||y(to)||)+C2||Mr) 



I oo,[to,t] 



+ do, do e 



2, U2 t JJ^>o 



(A.42) 



h{t) - h{to) = -7 / ||x(r)||^dr, 7 G M>o 

Jto 



(A.43) 



where [3 : W ^ W is a strictly monotone and asymptotically decreasing to 
zero function. Then trajectories x(t), y(t), h{t) passing through x(to) = xq, 
y(to) = yoj ^(^0) = ^0 at t = to are bounded in forward time provided that 



7< 



K - 1 



-1 



'd_' 

2k 



ho 



m [l|x(to)|| + ||y(to)||] + (Cl + C2)ho {l + f§ 



and 



e > PiO) 



d 

1 - - 

K 



H -1 



+ 1 {di + d2). 



(A.44) 
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Without loss of generality we introduce a strictly decreasing sequence 

{dj}, i = 0, 1,..., 
such that (Tq = 1, and (jj asymptotically converge to zero. Let 

{U}, z = 1, . . . 
be an ordered sequence of time instances such thaiH] 

h(ti) = (Jih{to). 

Similar to our earlier work |28j we wish to show that the amount of time 
needed to reach the set specified by ||x(t)|| = from a given domain of initial 
conditions is infinite. 

The time difference T, = — ti-i can be estimated as 



Ti||x(r)|L . ,i> 



7 



T,>1 ^ K^)lloo,[t,_i,ij-^' 

(A.45) 

Suppose that ||x(r)||^ ^.j — £^ < 0. In this case the amount of time needed 
for the system to reach the set h = h^cTi is infinite. Hence h{t) G [hoCJi, /iocrj_i] 
for all t > tj_i, and according to (lA.42p . trajectories x(t), y(t), h{t) will be 
bounded in forward time. Consider the case when ||x(r)||^ ^.j — £ > for 
all i. 

We introduce the following sequence {tj}, Tj = r*, r* G M>o, i = 1, . . . . 
Sequence {rj = t*} gives rise to the series with divergent partial sums X^i Ti = 
X^jT*. Hence proving that 

T. > r* ^ r,+i > r* V ^ 

will constitute the proof that x(t), y(t) are bounded for all t > to. Let Tj > r* 
for all 1 < j < i — 1 and consider 

l|xWIL,[t,_,A] ^ /^(o)(llx(^i^i)ll + lly(^^-i)ll) + ci/iocr.-i + 

< [2/?(T,_i) ||x(t,_2)|| + 2/3(r,_i) ||y(ti-2)|| + (ci + C2)/ioc^^-2] 
+ (ci + C2)/io(x,_i + f3{0){di + 4) + (c?i + d2) < 



4/3(0) /32(r*)||x(t,_3)||+4/3^(r*)||y(t.-3) 



P. 



^ In case this equality does not hold, nothing remains to be proven; for ||x(t)|| will 
always be away from zero for all t > to- 
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where 



P2 =P{0) [2/3(r*)(ci + C2)(Ti_3 + (ci + C2)ai_2] ho + (ci + C2)ai-iho 
+ /3(0) [2/?(r*)(c/i + c/2) + {di + c/2)] + {di + ^2) 



Repeating this iteration with respect to i leads to 



X r 



''j-4J 



= (ci + C2)M(0) [22/52(r*)a,„4 + 2/?(r*)(T,_3 + + cr.-i(ci 
+ {di + c/2)/5(0) [22/?2(^*) + 2/3(r*) + 1] + (c/i + d^) 



= (Cl + C2)M(0) 
+ {di + rf2)/3(0) 



j=0 



j=0 



+ (ci + C2)hoai-i 
+ {di + (^2), 



and after i — 1 steps we obtain 

iix(r)iL,[,^_^,,] < mmr*)y-\Mto)\\ + wyim + a 

+ (ci + C2)hocri_i 



i-l 



Pi.l =(Ci + C2)M(0) 

+ (rfi + d2)/3(0) 
From (1A.45I) it follows that 



|:2^/3^-(r*)a._,_2 
i=o 

j-2 



(A.46) 



i=o 



+ [di + di) 



7(Tr\ ||x(r 



Hence, if we can show that there exist xq, yo such that such that for some 
Ao G M>o and e: 

- (jj ho 



> Ao 



(A.47) 



the following holds 

7cr-\ (||x(r)|L_[,^_^^,^] - e) < 75(xo,yo) < Ao V z (A.48) 
where B{-) is a function of xo, yo, then boundedness of trajectories will follow. 
Consider the term (T~.\ ||x(''")|Ioo [u^i ij' 



(Ji = —, K> 1 
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According to (1A.46P we have: 



(l|x(r)|L,[,.^,^] -5) < m [ar\(2/3(r*))-i] (||x(to)|| + ||y(to)||) 
+ ar\p,_i = /5(0)((«: ■ 2 ■ /3(r*))-i(||x(to)|| + ||y(to)||) + ^-'P^-l - ^'^'e 



i-2 



= ■ 2 ■ (3{T*)y-\Mto)\\ + lly(to)ll) + (ci + C2)M(0)«: 

(i-2 
/?(0)(rfi + c/2) E + (di + d2)-e 

j=0 

Then, choosing the value of r* as 

2Kp{r*) <d, de (0, 1) 
results in the following estimate: 



j=0 



(A.49) 



-e}< 5(xo, yo) = [3(0) IMto) II + ||y (to) ||] 



+ (ci + C2)ho 1 + 



/3(0)ft:^ 
1-d. 



+ k'~' {di + d2 



1-f 



— e 



Condition (IA.44p implies that k*"^ ( {di + ^2) 



/3(0) 



+ 1 



£ < 0. Hence 



+ (ci + C2)ho { 1 + 



- < fi(xo, yo) = /3(0) [||x(to) II + ||y (to) II] 



1 - d 



Solving ( ]A.49I) . ( 1A.47I1 with respect to Aq results in 

/t- 1 



Ar 



-1 



ho 



This in turn implies that for all Xq, yo, such that: 

-1 



7< 



K-1 



K 



d 

2k 



to 



m) [||x(to)|| + ||y(to)||] + (ci + C2)/.o (1 + ^ 



the following implication must hold. 

Therefore, trajectories x(t), y(t), /i(t) passing through x(to) = xq, y(to) = yo, 
hito) = ho at t = to are bounded in forward time □ 
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